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'j  Sciences  subsequently  contracted  with  the  Aviation  Research  Laboratory  (ARL) 
of  the  University  of  Illinois  to  develop  a  FAULT  simulation  compatible  with 
the  PLATO  system.  The  PLATO  system  is  used  extensively  by  the  Army  for  both 
training  and  research  purposes . 

s'  '  In  order  to  meet  the  Army1 s  needs,  ARL  researchers  made  certain  key 
I  modifications  to  the  original  FAULT  simulation  which  facilitate  its  use 
\by  troubleshooters  and  Army  researchers. 

As  a  training  tool,  PLATO  FAULT  simulates  troubleshooting  decisions  in 
a  game  format.  The  object  of  the  game  is  to  find  the  single  failed  part  as 
quickly  as  possible  while  incurring  the  minimum  expense.  The  instructions 
and  on-line  help  provided  to  the  trainee  have  been  redesigned  to  provide  more 
information  in  natural  language.  Throughout  the  simulation  the  trainee  has 
available  a  number  of  options  that  allow  him  to  (1)  gather  information  about 
the  problem,  (2)  act  on  the  information,  and  (3)  receive  information  about  the 
action.  To  present  a  realistic  simulation  of  actual  troubleshooting,  FAULT 
assigns  dollar  charges  to  certain  options  and  the  list  of  options  has  been 
clearly  presented  to  differentiate  between  options  that  are  free  and  those 

that  incur  costs.  (  .... - 

For  use  in  research,  the  PLATO  version  of  FAULT  allows  the  researcher 
to  create  demonstrations  and  experiments.  The  version  provided  to  the  Army 
contains  one  operational  technical  system  (TRUCK  ENGINE)  for  immediate  use 
and  the  necessary  documentation  to  modify  this  system  and  develop  additional 
ones.  Furthermore,  the  programming  allows  the  experimenter  to  select  the 
problems  that  will  be  presented  to  the  troubleshooter.  The  collection  and 
accessibility  of  data  have  also  been  enhanced:  data  can  be  collected  and 
stored  simultaneously  from  numerous  PLATO  IV  terminals  and  this  data  can  be 
accessed  either  on  a  global  level  (i.e. ,  average  times  and  costs  to  problem 
solution)  or  on  a  very  specific  level  (i.e.,  listing  of  each  action  required 
to  solve  a  problem) . 
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Executive  Summary 


1 


This  report  for  the  United  States  Army  Research  Institute  for 
the  Behavioral  and  Social  Sciences,  Alexandria,  Virginia,  fulfills 
the  terms  of  contract  MDA  903-82-M-3924  for  the  design 
specification  and  final  report  of  the  computer  simulate  1 
hereafter  referred  to  as  PLATO  FAULT. 

The  report  contains  a  description  of  PLATO  FAULT  and  includes 
the  appropriate  screen  copies  to  demonstrate  the  simulation  to  the 
reader.  Also  included,  predominantly  as  appendices,  is 
documentation  for  the  researcher. 

This  report  has  been  reviewed  and  is  approved  for 
publication,  August,  1982. 


Henry  L.  Taylor,  Acting  Head 
Aviation  Research  Laboratory  and 
Director,  Institute  of  Aviation 
University  of  Illinois  at  Ur bana-Champalgn 
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I •  Introduction 


The  University  of  Illinois,  primarily  at  the  Coordinated 
Science  Laboratory  under  Professor  William  B.  Rouse,  has  been 
involved  in  a  variety  of  computer-based,  problem-solving  research 
projects.  During  1979,  under  contract  MOA  903-79-C-942 l ,  a 
simulation  named  FAULT  (Framework  for  Aiding  in  the  Understanding 
of  Logical  Troubleshooting)  was  developed  and  evaluated.  The 
conceptualization,  development,  and  evaluation  of  the  simulation, 
which  Included  ten  experiments  with  live  subjects,  have  been 
reported  extensively  (Hunt,  R.M.,  1979;  Hunt,  R.M.  and  Rouse, 
W.B.,  1981;  Johnson,  W.B.,  1981;  Johnson,  W.B.  and  Rouse,  W.B., 
1982,  b;  Johnson,  W.B.  and  Rouse,  W.B.,  1932,  c;  Rouse,  W.B.  and 
Hunt.  R.M.,  1982). 

The  present  project  had  the  goal  of  capitalizing  on  the 
previous  empirical  evaluations  to  develop  a  FAULT  simulation 
compatible  with  the  PLATO  system  (Johnson,  1982).  The  project  had 
the  contractual  obligation  to  develop  a  simulation  with  at  least 
one  technical  system.  The  simulation  had  to  permit  the 
simultaneous  collection  and  storage  of  data  from  numerous  PLATO  IV 
terminals.  A  program  had  to  be  written  to  make  the  data 
accessible  to  the  Army  Research  Institute  (AR1)  experimenter. 

The  meeting  of  May  26,  1982  at  ARI  with  Douglas  Bobko, 
Carolyn  Carroll,  Michael  Drillings,  Dick  Gebhard,  John  Hays,  Rich 
Johnson  and  W.B.  Johnson,  made  it  clear  that  ARI  wanted  a 


demonstration  tool  that  could  be  used  conveniently  throughout  the 


extensive  Army  PLATO  system.  it  was  emphasized  that  the  computer 
code  should  contain  the  necessary  comments  and  explanations  to 


facilitate  modification  by  ARI  programmers.  PLATO  FAULT  meets  or 
exceeds  the  contractual  specifications. 

II.  PLATO  FAULT 


In  order  to  use  PLATO  FAULT,  one  must  us 
of  the  specific  technical  system  which 
troubleshooting  simulation.  PLATO  FAULT  is 
with  Truck  Engine  (see  Figure  1).  We  modifie 
descriptions  of  an  earlier  simulation.  Car  En 
Truck  Engine. 
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Figure  l:  Hardcopy  Diagram  of  Truck  Engine  for  PLATO  FAULT 
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While  execution  of  the  PLATO  lesson  “FAULT"  Is  completely 
self-explanatory,  when  using  a  PLATO  IV  terminal,  this  section 
will  describe  each  action  available  to  the  troubleshooter.  The 
simulation's  screen  display  is  shown  In  Figure  2. 


System:  Truck  Engine  Problem:  13  of  28 

Symptom:  The  engine  runs  rough  and  is  hard  to  start. 


Gauges 

Ret  ions 

Costs 

20  TACHOMETER 

MARGINAL 

1  023  SPARK  PLUG  HIRES. 

t  2 

3*  manifold  pressure  marginal  l 

27  SPARK  PLUGS  -  ABNORMAL 

31  FUEL  PRESSURE 

MARGINAL 

2  BIG  ROTOR  -  NORMAL 

6 

32  E6T 

MARGINAL 

3  022  CAMSHAFT. 

4 

33  FUEL  QUANIITV 

NORMAL 

6  DISTRIBUTOR  -  ABNORMAL 

34  VOLTMETER 

NORMAL 

4  018  TIMING  GEARS. 

3S 

22  CAMSHAFT  -  NORMAL 

5  022  CAMSHAFT, 

4 

14  FUEL  PUMP  -  ABNORMAL 

6  REPLACE  22  CAMSHAFT 

13*9 

Options 

Free 

Expense 

INFORMATION  IX 

OBSERVATION  OX.V 

COtTARISON  CX.V.Z 

BENCH  TEST  BX 

DESCRIPTION  OX 

REPLACE  PARI  RX 

CRUCES  CX 

GIVE  UP  ? 

POSSIBLE  P 

CX.  V.  AND  Z  DENOTE  PRRT  NUMBERS.  1 

Choose  an  option  or  press  HELP  for  help  r22 


R  l  ght  !  You  have  repl  aced  the  f a  i  1  ed  part 


Press  NEXT  to  see  how  wel  1  you  did  compared  to  others. 


Figure  2:  Terminal  Display  of  PLATO  FAULT 
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The  previous  experiments  with  FAULT  clearly  indicated  that 
the  simulation  was  most  effective  when  it  provided  maximum 
information  about  the  system  and  its  associated  testing 
procedures.  Further,  it  seemed  to  be  valuable  to  provide  maximum 
information  about  the  sequence  of  tests  that  had  been  performed. 
This  information  had  to  be  presented  in  a  concise  screen  display 
that  would  be  very  readable,  even  to  the  novice  simulation  user. 
For  this  reason,  we  chose  to  capitalize  on  PLATO's  graphic 
capability  and  redesign  the  display. 

The  display  contains  several  data  elements.  "System:  Truck 
Engine"  is  listed  at  the  top  left  of  the  display.  This  feature 
will  be  particularly  Important  when  other  systems  are  in 
operation.  Below  the  system  name  is  the  symptom  information: 
“Symptom:  The  engine  runs  rough  and  is  hard  to  start."  At  the  top 
right  of  the  display  is  the  Information  that  this  is  the 
thirteenth  of  twenty-eight  randomly  presented  problems:  “Problem: 
13  of  28."  The  experimenter  may  choose  which  problems  will  be 
given.  The  object  of  the  game  is  to  find  the  single  failed  part 
as  quickly  as  possible  while  incurring  the  minimum  expense.  We 
feel  that  the  time  vs.  money  tradeoff  is  representative  of  the 


real  world  of  equipment  troubleshooting. 

The  top  left  quadrant  displays  gauge  information.  In  this 
example,  all  the  gauges  have  been  read.  Since  the  troubleshooter 
typed  "g”  followed  by  a  gauge  number  and  repeated  this  action  for 
each  gauge  number,  the  gauge  readings  required  six  separate 


actions  which  were  recorded  in  the  student  data  file 


The  lower 
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left  quadrant  of  the  Large  square  In  Figure  2  Is  the  list  of  nine 
possible  options.  These  options  allow  the  troubleshooter  to 
gather  information  about  the  problem,  act  on  the  Information,  and 
to  receive  information  about  the  action.  The  list  of  options  Is 
divided  into  two  sections,  one  with  free  options,  the  other 
requiring  an  expenditure  of  funds. 

The  first  free  option  is  "Infornation"  (see  Figure  3).  This 
block  provides  information  about  the  function  of  the  part,  the  a_ 
priori  probability  of  failure,  and  the  costs  associated  with 
observation,  bench  testing,  and  replacement. 


Information  about 

The  camshaft 

Cams  ha  f t 

opens  the  valves 

in  the  proper 

order 

Probability 

Cost  to 

Cost  to 

Cost  to 

of  Failure 

Observe 

Bench  Test 

Replace 

.02 

$4 

$  37  5 

$1300 

3 :  Inforsat ion 
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The  next  free  option  is  "Comparison."  The  comparison  option 
will  display  any  three  parts  with  information  about  costs  and 
probability  of  failure  (see  Figure  4). 


Comparison 


Part 

Probability 

Cost  to 

Cost  to 

Cost  to 

Number 

of  Failure 

Observe 

Bench  Test 

Replace 

1 

.09 

$  4 

$  15 

$  135 

5 

.01 

$  2 

$  27 

$  43 

15 

.01 

$10 

$1000 

S  2  1 00 

Figure  4:  Comparison 


The  "Description"  option  shows  the  methods  of  performing  a 
bench  test  and  provides  specific  steps  for  the  test,  including  a 
listing  of  the  appropriate  tools  (see  Figure  5). 


How  to  Bench  Test  Timing  Gears: 


Remove  the  radiator,  water  pump,  harmonic  balancer,  and  timing 
gear  cover.  Visually  inspect  the  timing  gears  for  mechanical 
wear.  The  chain  should  not  be  excessively  loose.  Check  the 
manual  for  tolerances  on  chain  and  for  gear  backlash. 


s 


“Cause"  option  has  been  briefly  described  previously  and  can  be 
seen  in  the  full  panel  display  in  Figure  2. 

The  last  of  the  free  options  is  P  for  "Possible."  This 
choice  provides  the  troubleshooter  with  the  number  of  parts  that 
remain  within  the  feasible  set  of  potential  failed  parts.  The 
semi-intelligent  feature  of  the  simulation  is  based  solely  on  the 
topography  of  the  hardcooy  display  in  light  of  the  tests  performed 
( see  Figure  6 ) . 


Possible 

Based  on  your  previous  actions,  there  are  _  remaining 

parts  that  could  be  the  failed  part. 

Figure  6:  Possible 


The  options  listed  in  the  "Expense”  column  of  Figure  2  are 
the  types  of  action-oriented  procedures  th3t  would  be  accomplished 
by  a  real-world  troubleshooter.  The  first  of  these  actions  is 
"Observation."  This  action  determines  the  quality  of  the  output 
from  one  part  to  the  next.  Steps  1,  3,  4  and  5  in  the  ACTION  list 
of  Figure  2  are  examples  of  observations.  When  the  observation  is 
performed,  the  details  of  undertaking  the  action  are  depicted  at 
the  bottom  of  the  display  as  shown  in  Figure  7. 


Observation  on  Spark  Plus  Wires 

The  output  from  the  spark  plug  wires  is  abnormal. 

Remove  the  wire  at  the  plug  end.  Hold  the  wire  approximately 
1/S  inch  from  ground  and  crank  the  engine.  A  crisp  blue  spark 
should  jump  the  gap  and  no  shock  should  be  felt  through  the 
wires. 

Figure  7:  Observation 

The  "Bench  Test"  is  the  second  expense  option.  When  the 
bench  test  is  performed,  the  troubleshooter  essentially  removes 
the  suspect  component  from  the  system  for  a  thorough  check.  Step 
2  (”B19  Rotor-Normal")  in  the  Action  list  of  Figure  2  is  an 
example  of  a  bench  test.  Although  this  test  is  expensive  due  to 
the  labor  of  removal,  downtime,  etc.,  it  is  the  only  sure  way  of 
establishing  the  functional  integrity  of  a  given  component. 
"Replace  Part"  is  self-explanatory.  When  the  troubleshooter  has 
incorrectly  replaced  a  functioning  part,  he  receives  a  statement 
to  that  effect.  When  replacement  is  appropriate,  the 
troubleshooter  is  reinforced  in  his  decision  by  a  positive 
statement  and  is  provided  with  a  problem  summary.  When  a 
replacement  is  preceded  by  a  bench  test  of  the  same  part  the  cost 
of  replacement  Is  modified. 

The  performance  summary,  depicted  in  Figure  3,  includes  the 
troubleshooter's  time  and  cost  compared  to  the  mean  values 


associated  with  that  problem. 


Further 


the  summary  lists  the 


number  of  unnecessary  steps  compared  to  the  mean  number  of 
unnecessary,  or  redundant,  actions  performed  on  that  problem. 


Total  Test 

Total 

Total 

Unnecessary 

Cost 

Time 

Actions 

Actions 

You 

$1339 

1:35 

7 

1 

Average  of 

5  users 

$1335 

1:07 

10 

3 

Figure  8:  Performance  Summary 


“Give  up"  permits  the  frustrated  problem  solver  to  quit  a 
problem  by  typing  "?".  The  penalty  for  giving  up  Is  the 
replacement  of  all  system  components  at  a  cost  equal  to  the 
total  replacement  cost  of  all  components.  PLATO  FAULT  adds 
these  Individual  part  costs  In  a  slow  running  total  while 
allowing  the  troubleshooter  to  abort  this  procedure  at  any 
time . 


.  — ^  "Vf  *  — 
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III.  FAULT  Documentat Ion 


The  documentation  for  PLATO  FAULT  is  divided  into  two 
separate  sections.  The  first  section  is  a  manual  for  the  user 
of  the  simulation.  The  second  section  is  written  for  the 
experimenter  . 

A.  Troubleshooter's  Manual 

The  hardcopy  information  needed  by  the  PLATO  FAULT 
troubleshooter  is  limited  to  the  system  schematic.  All  other 
explanations  about  FAULT  are  presented  on-line,  via  the  HELP 
key.  This  Information  is  included  in  Appendix  A. 

B.  Researcher's  Manual 

A  test-management  index  for  the  researcher  is  provided  in 
the  TUTOR  program,  "faultman."  The  options  available  from 
this  index  are  described  in  an  on-line  HELP  section,  as  shown 
in  Appendix  B. 
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IV.  Project  Suamary  and  Future  Research 

The  project  ha9  developed  a  PLATO-based  simulation  quite 
similar  to  the  FAULT  simulation  developed  by  Rouse  and  his 
associates  at  the  University  of  Illinois.  The  simulation  was 
refined  to  serve  the  troubleshooter  and  researcher. 

The  PLATO  version  of  FAULT  makes  it  very  easy  for  the 
researcher  to  set  up  a  demonstration  or  an  experiment.  The 
researcher  has  the  ability  to  select  the  problems  that  will  be 
presented  to  the  troubleshooter.  Additionally,  it  is  very 
easy  for  the  researcher  to  access  the  troubleshooter  data. 
This  data  can  be  accessed  at  a  global  level  (l.e.,  average 
times  and  costs  to  problem  solution)  or  on  a  very  specific 
level  (i.e.,  listing  of  each  action  required  to  solve  a 
problem).  These  options  are  available  through  the  "Faultnan" 
lesson  (see  Appendix  B) . 

PLATO  FAULT  has  made  a  number  of  improvements  for  the 
troubleshooter.  The  display  has  been  redesigned  to  provide 
■ore  information  in  natural  language.  The  list  of  options  has 
been  split  to  clearly  differentiate  between  cost  related  and 
free  options.  Most  importantly,  PLATO  FAULT  has  been  enhanced 
with  numerous  on-line  aids  to  help  the  troubleshooter  through 
the  dynamics  of  the  simulation. 

The  suggestions  for  future  related  research  were 
presented  quite  extensively  in  the  Project  Status  report 
delivered  to  ARl  on  May  24,  1982.  While  the  ideas  presented 


>  —  **'T 
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Is  Chat  report  ran  an  extensive  gamut,  It  should  be  emphasized 
that  the  development  of  a  PLATO  FAULT  editor  should  be  of  the 
highest  ARI  priority*  This  editor  would  permit  ARI  to  develop 
new  systems  and  modify  existing  simulations. 
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APPENDIX  A 


FAULT  Help  Index 


1.  Introduction  to  FALLT 

2.  Free  Options 

3 .  Expense  Opt i ons 

4 .  Scor i ng 


Choose  an  option  or  press  BACK  to  return 


Press  SHIFT-BACK  from  anywhere  in  this  help 


section  to  return  to  the  help  index 


Introduction  to  FAULT 
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Troubleshooting  Options 


The  following  troubleshooting  options  are  available: 


Free 

Expense 

Information  lx 

Comparison  Cx,y,z 

Descr i pt i on  Dx 

Gauges  Gx 

Possible  P 

Observat i on  Ox ,  y 

Bench  Test  Bx 

Repl ace  Part  Rx 

G i ve  Up  ? 

(x,  y,  and  z  denote  part  numbers) 

The  options  listed  on  the  left  are  free,  while  the 
options  on  the  right  will  have  associated  costs. 

The  letters  following  each  option  will  help  you 
remember  how  to  request  that  option.  For  example, 
to  request  information  about  a  part,  you  would  type 
' i "  followed  by  the  part  number.  Use  the  ERASE  key 
to  make  any  corrections  or  changes.  Then,  press 
NEXT  to  enter  your  request . 

Following  is  a  description  of  the  information  that 
each  of  these  options  provides. 

Press  NEXT  to  continue  or  BACK  to  review. 
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Information  {lx}  **  FREE  ** 

To  request  information  about  a  given  part,  type  “ i " 
followed  by  the  part  number.  You  will  then  receive 
the  following  information: 

1)  The  a  priori  probability  of  failure 

2)  Observation  cost 

3)  Bench  test  cost 

4)  Repl acement  cost 

5)  A  short  functional  description 


Compar i son  {Cx,y,z}  **  FREE  ** 

To  obtain  information  on  up  to  three  parts  at  a 
time,  type  "c"  followed  by  the  numbers  of  the  parts 
to  be  compared,  separated  by  commas.  For  example, 
*cl2,34"  would  give  you  the  following  information: 


Part 

Number 

Probabi  1  ity 
of  Failure 

Cost  to 
Observe 

Cost  to 
Bench  Test 

Cost  to 
Repl ace 

12 

.02 

$2 

$35 

$135 

34 

.04 

Si 

$25 

$40 

Press  fOCT  to  continue  or  BACK  to  review. 


T  » 
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**  FREE  ** 


For  a  description  of  how  to  perform  a  bench  test  on 
a  part,  type  "d"  followed  by  the  part  number.  This 
option  also  tells  you  what  tools  and  manuals  are 
necessary  to  perform  the  test  in  the  real  world. 


Gauge  Reading  {Gx}  **  FREE  ** 

In  an  effort  to  gather  information  about  the  status  of 
the  system,  you  may  choose  to  observe  the  reading  on  a 
gauge.  To  do  this,  type  “g’  followed  by  the  number  of 
the  gauge.  You  will  receive  one  of  the  following 
responses: 

1)  Normal 

2)  High 

3)  Low 

-4)  Marginal 

5)  Variable 

6)  Zero 

You  will  not  be  charged  for  this  information,  but  there 
is  no  reason  to  check  gauges  unecessar i 1 y . 


Press  NEXT  to  continue  or  BACK  to  review. 


•vr  *  • 
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Possible  {P)  **  FREE  ** 

Type  "p ‘  for  this  option,  which  will  help  you  narrow 
down  the  number  of  parts  that  could  possibly  be  the 
defective  part.  Without  regard  to  the  symptom, 

PLATO  will  look  at  the  observations  and  bench  tests 
you  have  made  and  determine  how  many  parts  in  the 
system  could  possibly  be  the  failed  part. 


Press  NEXT  to  continue  or  BACK  to  review. 


s 


Cbservat i on  {Ox, y} 


SS  EXPENSE  $$ 


An  observation  is  made  between  two  parts  to  see  if 
the  output  from  the  first  part  to  the  second  part  is 
acceptable.  To  make  an  observation,  type  “o“,  then 
the  number  of  the  first  part,  then  a  comma,  then  the 
number  of  the  second  part.  For  example,  "ol,2*  would 
give  you  one  of  the  following  responses: 

1)  Normal  The  output  of  the  first  part  is 

accept abl e. 

2)  Abnormal  The  output  of  the  first  part  is 

unacceptable.  Either  the  first  part 
has  failed  or  one  of  its  inputs  is 
unaccept abl e . 

3)  Marginal  The  output  of  the  first  part  is 

marginal .  Either  the  first  part  is 
weak  or  one  of  its  inputs  is  weak. 

4)  Null  There  is  no  connection  between  the 

parts  you  have  selected. 

5)  Unavailable  This  observation  cannot  be  made  due 

to  the  specific  nature  of  the  parts 
invol ved. 

Press  NEXT  to  continue  or  BACK  to  review. 


Observat i on  {Ox,y}  (continued) 


$S  EXPEND  $$ 


Remember  that  the  purpose  of  making  an  observation 
is  to  see  if  the  output  from  the  first  part  to  the 
second  part  is  acceptable;  therefore,  when  typing  in 
the  part  numbers,  ORDER  IS  IMPORTANT.  You  can  also 
observe  a  terminal  part  (a  part  that  suppl ies  no 
output  to  another  part)  to  see  if  it  is  working 
properly.  To  do  this,  type  “o’  followed  by  the  part 
number. 

You  will  be  charged  for  each  observation  that  you 
make  according  to  the  time  and  effort  needed  to  make 
such  an  observation. 


Press  NEXT  to  continue  or  BACK  to  review. 


-  -  — -  ,  -*4T  ’  —  .i,^ *<*!••* 
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Bench  Test  {Bx}  $$  EXPENSE  $$ 

This  test  involves  removing  a  part  from  the  system  and 
testing  that  part  independently  of  the  rest  of  the 
system.  To  do  this,  type  "b"  followed  by  the  number 
of  the  part  to  be  tested.  You  will  then  receive  one 
of  the  following  responses: 


1) 

Normal 

The  part  is  working 

normal  1 y. 

2) 

fib normal 

The  part  has  failed  completely  and 

should  be  replaced. 

3) 

Marginal 

The  part  has  failed 
should  be  replaced. 

marg i nal 1 y  and 

You  will  be  charged  for  bench  tests,  and  they  do  tend 
to  be  expensive,  but  their  results  are  conclusive  and 
should  help  to  avoid  unnecessary  replacements. 


Press  NEXT  to  continue  or  BfiCK  to  review. 


Repl  ace  (Rx) 


$S  EXPEND  S$ 


When  you  think  you  have  located  the  failed  part, 
you  should  replace  that  part.  To  do  this,  type  “r  “ 
followed  by  the  part  number.  You  will  be  charged 
for  the  cost  of  the  part  and  the  time  to  repl ace  it. 
If  the  replacement  immediately  follows  a  bench  test 
of  the  same  part,  you  will  be  charged  the  difference 
between  the  two  action  costs.  In  other  words,  the 
bench  test  cost  will  be  counted  towards  the  cost  of 
repl acement . 


Give  Up  {?}  $$  EXPENSE  $$ 

As  a  1 ast  resort ,  i f  you  feel  that  you  cannot  sol  Ye  the 
problem,  this  option  will  allow  you  to  go  on  to  the 
next  problem.  To  do  this,  type  You  should  avoid 

this  action,  however,  because  you  will  be  charged  for 
replacing  every  part  in  the  entire  system. 


Press  NEXT  to  continue  or  BACK  to  review. 


FAULT  Scoring 


After  you  have  correctly  solved  a  problem,  you  will 
be  given  a  recap  of  what  you  did  and  how  much  you 
spent  before  going  on  to  the  next  problem.  To  give 
you  an  idea  of  how  your  performance  compares  to  that 
of  others  who  have  solved  the  problem,  the  following 
information  will  be  displayed: 


Total 

Total 

Total 

Unnecessary 

Cost 

T  ime 

Actions 

Actions 

You 

$19 

1:35 

7 

2 

Average  of 
271  users 

$27 

1:07 

10 

5 

To  avoid  inflation  of  these  averages,  the  results  of 
the  “Give  Up"  option  are  not  included. 

If  you  cannot  solve  a  problem  in  60  actions  or  less, 
you  will  automatically  go  on  to  the  next  problem. 


Press  NEXT  to  continue  or  BACK  to  review. 


APPEND  LX  B 


FAULT  Test  Manager  Help 

The  FAULT  Test  Manager  lets  you  collect  detailed 
performance  data  on  users  in  any  one  PLATO  group. 

The  problems  which  are  to  be  presented  can  be 
selected  ahead  of  time  instead  of  being  randomly 
chosen  from  all  possible  problems,  as  is  done  in  the 
regular,  non-testing  mode  of  operation.  There  is  a 
1 imit  of  100  users  for  which  data  can  be  stored  at 
one  time.  Before  you  give  a  test,  you  must  make 
sure  that  there  is  sufficient  space  available  to 
store  the  results  of  all  those  who  are  to  take  the 
test.  To  make  room  for  new  results,  you  must  delete 
some  or  all  of  the  old  results  via  options  in  this 
lesson  (see  below) .  You  might  want  to  make  a 
hardcopy  of  the  results  or  transfer  them  to  another 
file  before  deleting  them.  So,  a  typical  set  of 
steps  in  the  administration  of  a  test  would  include: 

1)  Copying  the  previous  test  results. 

2)  Deleting  the  previous  test  results. 

3)  Specifying  the  test  group. 

4)  Running  the  users  through  FAULT. 

5)  Clearing  the  test  group. 

A  description  of  each  of  the  options  available  to 
you  from  the  FALB_T  Test  Manager  index  follows: 

Press  NEXT  to  continue  or  BACK  for  the  index. 
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FAULT  Test  Manager 

1.  Specify  test  group  (currently  “arl  “) 

2.  Select  test  problems  (5  selected) 

3.  Inspect/edit  test  results 

■4.  Inspect/edit  problem  statistics 
5.  Delete  all  test  results 


Choose  an  option  or  press  HELP  for  help  ^ 


1 .  Speci  fy  test  group 


This  option  allows  you  to  speci fy  the  PLATO  group 
for  which  individual  test  data  are  to  be  collected. 
To  turn  off  the  collection  of  test  data,  clear  the 
specified  test  group  by  pressing  SHIFT-HELP.  The 
test  results  remain  available  until  specifically 
deleted  via  this  lesson. 


2.  Select  test  problems 

You  can  choose  which  problems  are  to  be  presented  to 
the  test  group.  Note  that  each  problem  corresponds 
to  one  failed  part  in  the  system  and  its  associated 
symptom  and  gauge  readings.  To  see  the  failure 
information  for  a  given  part,  enter  the  part  number 
and  press  NEXT.  You  can  then  add  the  problem  to  the 
test  by  pressing  LAB,  or  i f  the  problem  is  al ready 
selected,  you  can  delete  it  from  the  test  by  pressing 
SHIFT -HELP.  Each  problem  can  be  selected  only  once 
and  there  is  a  maximum  of  38  problems  that  can  be 
selected  for  any  one  test.  During  the  test,  the 
selected  problems  are  presented  in  a  random  order. 


Press  NEXT  to  continue  or  BACK  to  review. 


FAULT  Test  Editor 
(5  problems  selected) 
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2  ignit ion/starter  switch 
5  starter  solenoid 
7  points 
10  condensor 
23  spark  plug  wires 


Part  11:  fuel  line 

Symptom:  The  engine  runs  rough. 

Gauge  Readings: 


29 

30 

31 

32 

33 

34 

var 

high 

1  ow 

high 

norm 

norm 

Press  LAB  to  add  this  problem  or  BACK  to  select  another. 
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3.  Inspect/edit  test  results 

To  inspect  an  individual 's  test  results,  enter  the 
user’s  name  and  group,  then  press  NEXT.  You  have 
the  option  to  delete  the  user’s  test  results  at  this 
time  by  pressing  SHIFT-HELP.  If  you  prefer,  you  can 
get  a  listing  of  all  the  users  tested  by  pressing 
DATA,  from  which  you  can  choose  the  one  you  want. 

The  test  data  for  each  problem  for  each  user  consists 
of:  the  failed  part;  the  starting  and  finishing 

times;  the  total  time;  the  total  cost;  and  the  total 
number  of  actions  and  unnecessary  actions.  Also 
displayed  for  each  action  within  each  problem  are 
the  action  taken,  the  parts  involved,  the  result  of 
the  action,  the  cost,  the  time,  and  whether  or  not 
the  action  was  necessary. 


Press  NEXT  to  continue  or  BACK  to  review. 


33 


FAULT  Test  Results 
Data  stored  for  6  students. 


Enter  name/group 


ent w i st 1 e/ar 1 


Press  NEXT  to  see  records, 

SHIFT-HELP  to  delete  records,  or 
BACK  to  select  another  name. 
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FAULT  Test  Results 


1  entw i st 1 e/arl 

2  j  ohnson/arl 

3  ksg/arl 

4  tayl  or/arl 

5  van  proyen/arl 

6  ziegler/arl 


Enter  a  number  1 


Press  NEXT  to  see  records, 

SHIFT-HELP  to  delete  records,  or 
BACK  to  choose  another  number. 


>r  *• 
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Name:  entwistle/arl 


Problem:  2  of  5 


Fail ure :  condensor 

Started:  £8/27/82  at  £9:12:£4 

Finished:  £8/27/82  at  £9:14:37 


Ret  ion 

T  ime 

Cost 

1  g33 

norm 

£:  £2 

$ 

2  g3 1 

norm 

£:  £3 

3  c5,9, 12 

0:  20 

4  o9, 12 

norm 

0:05 

1 

5  o7, 13 

norm 

0:09 

1 

6  027,27 

ab  no 

0:28 

2 

7  i  1 3 

0:  12 

8  ol 3 , 16 

abno 

0:09 

2 

9  ol£, 13 

abno 

0:  10 

2 

1£  replace 

1£ 

0:  13 

5 

Total  time:  1 : 5£ 

Total  cost:  $13 
Unnecessary  actions:  £ 


Ret  ion 


Time  Cost 


Press  ♦  for  the  next  problem,  -  for  the  previous  one, 
or  press  a  number  key  to  advance  that  many  problems. 


Press  SHIFT-hOTT  or  SHIFT-BRCK  to  move  between  students 


36 


4.  Inspect  problem  statistics 

The  problem  statistics  include  the  average  time, 
average  cost ,  and  average  number  o  f  act i ons  and 
unnecessary  actions  needed  to  complete  each  problem. 
Note  that  these  averages  are  computed  from  al 1  users 
of  FAULT,  rather  than  from  the  current  test  group  or 
from  the  test  results  currently  stored.  For  this 
reason,  the  number  of  users  to  complete  each  problem 
is  included  in  the  statistics  display.  You  can 
initialize  all  the  problem  statistics  by  pressing 
SHI FT -HELP  on  the  statistics  display  page. 


5.  Delete  all  test  results 


This  option  permanently  deletes  all  of  the  test 
results  currently  stored.  The  problem  statistics 
remain  unchanged.  To  delete  the  test  results  of  an 
individual  user,  use  the  " inspect /edit  test  results" 
option.  Test  results  should  be  deleted  whenever  a 
new  group  is  to  be  tested  unless  you  want  to  combine 
the  results  of  more  than  one  group.  Remember  that 
there  is  a  1 imit  on  the  number  of  users  whose  test 
results  can  be  stored  at  one  time. 


Press  NEXT  for  the  index  or  BACK  to  review. 
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Average  Problem  Statistics 


Part  Name 

Users 

Total 

Cost 

Total 

Time 

Total 
Act  ions 

Unneeded 
Act  ions 

1 

battery 

1 1 

$  155 

0 

43 

6 

0 

2 

ignition/starter  switch 

13 

80 

0 

44 

8 

0 

3 

fuel  quant i ty 

10 

93 

0 

23 

5 

0 

4 

starter  bendix 

10 

655 

1 

33 

1 1 

0 

5 

starter  solenoid 

18 

154 

1 

16 

10 

0 

6 

distributor 

8 

406 

1 

06 

16 

0 

7 

points 

6 

40 

0 

49 

10 

0 

8 

fuel  tank 

4 

492 

0 

38 

7 

0 

9 

starter  motor 

3 

286 

0 

43 

12 

0 

10 

condensor 

12 

44 

0 

56 

1  1 

0 

11 

fuel  line 

10 

774 

1 

18 

15 

0 

12 

flywheel  ring  gear 

10 

1454 

3 

57 

13 

0 

13 

coil 

6 

135 

0 

52 

15 

0 

14 

fuel  pump 

8 

191 

0 

45 

12 

0 

15 

crankshaft 

1  1 

2783 

1 

1  1 

18 

0 

16 

distributor  cap 

7 

451 

2 

05 

16 

0 

17 

fuel  f  i  1  ter 

8 

102 

1 

06 

10 

0 

18 

timing  gears 

6 

1277 

1 

32 

15 

0 

19 

rotor 

5 

45 

0 

44 

1 1 

0 

20 

carburetor  float 

4 

770 

0 

57 

16 

0 

Press  NEXT  for  more  statistics. 

Pi  ess  SHIFT-HELP  to  zero  ALL  the  problem  statistics. 


